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ABSTRACT 

Supported by NASA’s Earth Surface and Interior (ESI) Program, we are producing a global set of Ground Control Points 
(GCPs) derived from the Ice, Cloud and land Elevation Satellite (ICESat) altimetry data. From February of 2003, to 
October of 2009, ICESat obtained nearly global measurements of land topography (± 86° latitudes) with unprecedented 
accuracy, sampling the Earth's surface at discrete ~50 m diameter laser footprints spaced 170 m along the altimetry 
profiles. We apply stringent editing to select the highest quality elevations, and use these GCPs to characterize and 
quantify spatially varying elevation biases in Digital Elevation Models (DEMs). In this paper, we present an evaluation 
of the soon to be released Global Multi-resolution Terrain Elevation Data 2010 (GMTED2010). Elevation biases and 
error statistics have been analyzed as a function of land cover and relief. The GMTED2010 products are a large 
improvement over previous sources of elevation data at comparable resolutions. RMSEs for all products and terrain 
conditions are below 7 m and typically are about 4 m. The GMTED2010 products are biased upward with respect to the 
ICESat GCPs on average by approximately 3 m. 

Keywords: ICESat, Laser Altimetry, Lidar, SRTM, GMTED2010, Digital Elevation Models, DEM, Geodetic Ground 
Control Points, GCP, Topography. 


1. INTRODUCTION 

A primary contribution of accurate laser altimeter elevation profiles is the independent characterization of systematic and 
random elevation errors in Digital Elevation Models (DEMs) produced by photogrammetric and Interferometric 
Synthetic Aperture Radar (SAR) techniques. By conducting this analysis the impact of DEM errors on the scientific and 
applied uses of the data can be assessed, including determination of elevation change by differencing DEMs acquired 
from different sources separated in time. The comprehensive, near global coverage across continents provided by 
NASA’s Ice, Cloud and land Elevation Satellite (ICESat) mission enables correction of long-wavelength DEM errors 
that can not be achieved by other means 11, 2 l We have used ICEsat data to evaluate the accuracy of the 30 and 90 m 
resolution, near-global DEM produced by the Shuttle Radar Topography Mission (SRTM) [3, 4 ' 3 ' 6] and the more recent 
global ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer) Global Digital Elevation Model 
(GDEM) [7] . The ICESat mission acquired single-beam, globally distributed laser altimeter profiles between ± 86° using 
the Geoscience Laser Altimeter Sensor (GLAS) [l,2 l Data was collected from February, 2003 to October, 2009 during 
approximately month long observation periods, three times per year through 2006 and twice per year thereafter. Three 
lasers were used sequentially during the mission. Data acquired with Laser 2 and 3 are used in this study. These 
altimetry profiles provide a highly accurate and consistently referenced elevation data set with quantified errors. We 
select laser altimetry elevation measurements from ICESat to generate Ground Control Points (GCPs) with sub- 
decimeter vertical accuracy and better than 10 m horizontal accuracy. ICESat waveforms represent the vertical 
distribution of energy reflected within the laser footprint from vegetation where present, and the ground where 
illuminated through gaps in any vegetation cover. The footprint diameter was nominally 70 m for Laser 1 and 50 m for 
Laser 2, and the footprints are space ever 170 m along the profile. Using attributes of the waveforms, we assess the 
accuracy of Digital Elevation Models (DEM) with respect to the highest elevations, the centroid (average elevation), and 
lowest elevations observed by ICESat for every laser footprint, and in some cases with respect to the ground identified 



beneath vegetation cover 181 where a distinct, low peak is present in the waveform. Table 1 shows the various ICESat 
observation periods, their collection dates and estimates of their pointing, horizontal and vertical accuracies. These 
estimates are based on the results of instrument calibration and validation using ocean scan maneuvers and cross-over 
analysis. The means and standard deviations are based on long orbit arc (~ 1,700 km) solutions 191 . The estimates shown 
in Table 1 correspond to data processed as Release 3 1 . 


Table 1 . ICESat observation periods, their timelines, transmit energy and long arc accuracy estimates from scan maneuvers 
and cross-overs. The laser used during each period is indicated by the number in the period designations. 


ICESat 
Observation 
Period 
<91 -day) 
Release .31 

Start Date 

End Date 

Laser 
Energy 
Corrected 
for FOV 
Shadowing 
Effects (mJ) 

Pointing 

accuracy 

(arcsec) 

Long arc 
(-1700 km) 
Estimate 
Horizontal 
Accuracy (m) 

Long arc 

(-1700 km) 

Estimate 

Vertical 

Accuracy 

0.4' Slope 

(cm) 

L2A 

10/13/2003 

11/19/2003 



0.79 ± 4.77 

0.6 ±3.3 

L2B 

2/17/2004 

3/21/2004 

45.6 

0.32 ± 1.28 

0.93 ±3.73 

0.7 ±2.6 

L2C* 

5/18/2004 

6/21/2004 

12.5 

0.13 ±3.54 

0.37 ± 10.30 

0.3 ±7.2 

L2D 

11/25/2008 

12/17/2008 

5.4 

0.59 ±2.53 

1.72 ±7.36 

1.2 ± 5.14 

L2E 

3/9/2009 

4/1 1/2009 

2.8 

0.80 ±2.75 

2.32 ± 8.01 

1.6 ±5.59 

L3A 

10/3/2004 

1 1/8/2004 

63.7 

0. 19 ± 1.13 

0.56 ±3.29 

0.4 ±2.3 

L3B 

2/17/2005 

3/24/2005 

59.1 

0.02 ± 1 .44 

0.07 ±4.20 

0.1 ±2.93 

L3C* 

5/20/2005 

6/23/2005 

45.5 

0.10 ± 1.00 

0.29 ± 2.92 

0.2 ± 2.04 

L3D 

10/21/2005 

1 1/24/2005 

39.4 

0.02 ±0.98 

0.07 ± 2.86 

0.1 ±2.0 

L3E 

2/22/2006 

3/28/2006 

34.1 

0.00 ± 1.17 

0.00 ±3.41 

0.0 ±2.38 

L3F* 

5/24/2006 

6/26/2006 


0.47 ± 1.52 

1.35 ±4.42 

1.0 ±3.08 

L3G 

10/25/2006 

1 1/27/3006 

27.1 

0.02 =fc 1.16 

0.07 ±3.37 

0.1 ±2.35 

L3H 

3/12/2007 

4/14/2007 

22.6 

0.00 ± 1.48 

0.00 ± 4.29 

0.0 ±3.0 

L3I 

10/2/2007 

1 1/5/2007 

20.5 

0.22 ± 0.76 

0.65 ±2.22 

0.5 ± 1.55 

L3J 

2/17/2008 

3/21/2008 

17.7 

0.21 ± 1.60 

0.62 ± 4.66 

0.4 ±3.25 

L3K* 

10/4/2008 

10/19/2008 

15.6 

0.05 ± 1.29 

0.15 ±3.74 

0.1 ±2.61 

*Airplane Mode 
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Fig. 1. ICESat average transmit energy (mJ), corrected for receiver field of view (FOV) shadowing effects, for the Laser 2 
and 3 observation periods used in this study. Degradation of laser performance caused a more rapid decrease in energy 

than was expected. 


In this paper, we describe our development of an ICESat geodetic ground control point (GCP) database and its use 
evaluating the Global Multi-resolution Terrain Elevation Dataset 2010 (GMTED2010) in Australia, for 4 of the DEM 
products that will later be distributed publically. We identify mean biases per ICESat observation period separately, 
documenting that the ICESat results are highly reproducible, in spite of the effects of instrumental parameters 
















































































































characteristic of each operating laser which may introduce small inter-period biases, such as the transmit energy, on the 
observations (Figure 1). 

We apply stringent editing criteria to yield a high quality GCP database. We exclude ICESat data identified as returns 
from water based on the ENVISAT MERIS Globcover land cover classification 1101 . ICESat data from clouds is excluded 
by editing elevations that are above SRTM elevations by more than 50 m. We exclude data where the width of the 
waveform implies there is a significant height range detected within the laser footprint due to relief (slope and/or 
roughness of the ground) and/or vegetation cover. The impulse response for GLAS, that is the width of the received 
waveform from a flat, smooth target, is approximately 7 nsec (1 m) (the full width at half the peak amplitude) and 
approximately 17 nsec (2.5 m) at its base (the width from the start to the end of the waveform signal at a low threshold 
above the background noise). To obtain highly accurate GCPs we select waveforms with widths from signal start to end 
less than 5 m, indicating the within-footprint relief is very low and vegetation, if present, is of low stature. We also apply 
editing based on instrumental parameters. Returns with low received energy are excluded by only using returns with 
maximum amplitudes greater than 0.15 Volts, and widths > 0.5 m. Saturation broadens, distorts and truncates the 
received waveforms when the return energy exceeds the receiver’s or the digitizer’s dynamic range. Although laboratory 
calibrations developed as a function of receiver gain and observed received energy exist to correct elevations and receive 
energies, we only keep non-saturated to minimally saturated data. We use data when the saturation index (the number of 
waveform bins with an amplitude greater than the saturation threshold) is two or less, and the available correction to the 
elevation is applied for those slightly saturated returns. We minimize data that may be affected by waveform broadening 
due to incidence angle between the laser beam vector and the normal to the surface slope by excluding data acquired 
when the laser beam was pointed off from nadir by more than 1°. We also exclude waveforms with pulses narrower than 
the transmit pulse. Rigorous analysis has shown that for low relief locations the ICESat data meet the accuracy 
requirements of 6 m horizontal and 10 cm vertical (Table 1) [9] . This accuracy was somewhat degraded during the laser 
operating periods where the spacecraft was flying in airplane mode, indicated in Table 1 with an asterisk. However, we 
expect that our GCPs are of equivalent accuracy for all periods based on the stringent editing criteria applied to the data. 

GMTED2010 is a collaborative effort between the U.S. Geological Survey (USGS) Earth Resources Observation and 
Science (EROS) Data Center in Sioux Falls, South Dakota and the National Geospatial-Intelligence Agency (NGA) 111, 
12] . This new global elevation product suite has been generated as a replacement to the 1996 vintage GTOPO30 dataset 
(30 arc-seconds spacing, or approximately 1 km) for topographic data applications at the global and continental scale 11 '’ 1 . 
The accuracy of the GTOPO30 data set was evaluated in a manner similar to that used here, but with a less 
comprehensive approach using a lower accuracy laser altimeter data set acquired by the Shuttle Laser Altimeter 114, 151 . 
GMTED2010 has been generated at three separate resolutions (horizontal post spacing) of 30 arc-seconds 
(approximately 1 kilometer), 15 arc-seconds (approximately 500 meters), and 7.5 arc-seconds (approximately 250 
meters) where supported by the input source data. In addition, there will be seven new raster elevation products produced 
for each resolution. While executing the aggregation procedures, minimum elevation, maximum elevation, mean 
elevation, median elevation, standard deviation of elevation, systematic subsample, and breakline emphasis products 
have been produced. Based on the selected aggregation strategy, a systematic thinning of the full resolution source data 
was performed to produce the reduced resolution versions at each of the output grid spacings. These new products use 
the SRTM Digital Terrain Elevation Data (DTED®2) (void-filled) 1 arc-second DEM as its primary source 
(approximately 70% of its source) 13, l6 l Because the GMTED2010 products have been generalized from higher resolution 
sources than those used in the GTOPO30 production, the new generalized products exhibit more topographic detail than 
GTOPO30. Upon its distribution, the generalized raster elevation products, spatially referenced metadata, and full dataset 
documentation will be released with the documentation highlighting the input datasets, processing methods, data 
characteristics, and validation results based on a selected set of NGA geodetic control points. Distribution of this new 
dataset is expected later this year. Following the commencement of the public release, the products will undergo another 
thorough accuracy assessment using additional control data and will include an evaluation of other continents using 
ICESat altimetry data. 

For this paper, we have assessed the agreement between ICESat centroid and ground elevations (essentially the same for 
narrow waveform returns) at the ICESat footprint location, and produced estimates of the differences based on land 
cover and relief for four of the layers in the GMTED20 10 product. Those layers are the Mean and Median for the 15 arc- 
second resolution, and the Mean and Systematic Discrete Subsample products for the 30 arc-second resolution. The 
mean and median products are computed using all cells from the higher resolution source data that are located within the 
lower resolution GMTED2010 cell. The discrete subsample elevation is that of the source data cell at the center of the 
GMTED2010 cell. The GMTED2010 products were provided in geographic coordinates referenced to the WGS-84 



horizontal datum, with the horizontal coordinates expressed in decimal degrees. The elevation values are integer meters, 
referenced in most cases to the EGM96 geoid as the vertical datum, but for sources other than SRTM or SPOT 5 
Reference3D data, the vertical datum varies according to the source data and no vertical datum adjustments were 
performed. Where the SRTM data was the primary higher resolution data source, each 30-arc-second pixel has been 
generalized from 900 1-arc-second SRTM pixels (30 by 30 cells). One 30-arc-second pixel is spatially coincident with 
four 15-arc-second pixels, and each 15-arc-second pixel is coincident with four 7.5-arc-second pixels. Data 
characteristics such as the projection system, coordinate units, and horizontal and vertical datum vary among the input 
data sources. With the exception of the vertical datum, these input data characteristics were systematically converted to a 
consistent set of parameters prior to the generalization and creation of the global seamless elevation dataset. 

Since the ICESat elevations are distributed with respect to the Topex/Poseidon ellipsoid, ICESat elevations were 
converted to the WGS-84 ellipsoid and the EGM96 geoid corrections were applied in order to evaluate the GMTED2010 
products. Although the vertical datum differences between the input data sources were not transfonned in the 
GMTED2010 products, the effects on mean biases that may result from these discrepancies have not precluded this 
dataset from performing well below their accuracy requirements. The elevation differences between the ICESat data 
selected for ground control and selected GMTED2010 product layers (Discrete Subsample, Mean, and Median) were 
computed, and statistics compiled. 


2. PRELIMINARY EVALUATION OF GMTED2010 PRODUCTS FOR AUSTRALIA 

2.1 GMTED2010 Data Sources in Australia 

The primary source dataset for the new global model in Australia is NGA’s Shuttle Radar Topography Mission (SRTM) 
DTED®2 (void-filled) 1 -arc-second data 13, 161 . These data covers approximately 80 % of the Earth’s land surface 
(between 60°N and 56°S), and represents a significant upgrade to the source data included in the GTOPO30 elevation 
data 1 ” 1 . The void-filled SRTM data used in the production of these data are a revised version that is not currently 
publicly available. In addition to the voids being filled, the dataset contains further data editing not included in the 
original release 1161 . The void fill process was done such that it closely follows the trend of the original SRTM surface 
while retaining the useful characteristics from the source fill data. There were three main causes for voids in the SRTM 
data: a few patches of land in North America missed because the radar sensor did not collect data during 10 orbits of the 
mission, shadow and layover effects caused by steep slopes, and poor radar returns from certain areas with sandy soils 
(e.g. northern Africa) 131 . The voids in the SRTM dataset for Australia were filled using the GeoData 9-Arc-Second bare 
earth product produced by Geoscience Australia prior to generalization (see Figure 9 in 1 ' !1 ) [l7 l 

For this preliminary analysis we do not have information in the form of a flag that can help us assess elevation biases 
based on source data. Therefore, all statistics are shown based on the differences with respect to ICESat elevations minus 
the GMTED2010 DEM at the various resolutions independent of source data. In addition, we have performed a 
comparison between ICESat and an earlier version of the “finished” SRTM data (v2.0), publically available from the 
EROS Data Center, which is provided with the ICESat products. 


3. RESULTS 

3.1 Differences between ICESat, SRTM and GMTED2010 

The Australia ICESat GCP data selected by our editing for one representative observation period is shown in Figure 2, 
plotting differences between the ICESat centroid and GMTED2010. Also shown are elevation difference distributions 
for representative ICESat observation periods acquired with Laser 2 and Laser 3. Differences between ICESat and the 
various elevation products exhibit normal distributions centered about the mean. Table 2 shows the difference statistics 
for a representative laser period between the four waveform-derived ICESat elevations and the SRTM product at 90 m 
resolution, and GMTED2010 products for the 15 arc-second and 30 arc-second resolutions. Differences with respect to 
the ground are very similar to those for the centroid for the narrow waveforms selected for our GCP database; the 
difference between the highest and lowest elevation differences correspond to the mean pulse width in the GCP dataset. 
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Fig. 2. Map of elevation differences between the L2B ICESat period GCPs and the GMTED2010 mean 15 arc-second 

product, scaled between -10 and 10 m, and histogram distributions of the ICESat centroid elevation differences with the 
finished SRTM data on the ICESat product (red), the 15” Mean (blue) and 30” Mean (green) GMTED products using 
GCPs from the L2A and L3A observation periods. 

When the high resolution source elevation data were generalized to the reduced resolution GMTED2010 products values 
representing the mean, median and discrete sample elevations from the full resolution source data were assigned to the 
center of the GMTED2010 cells,. Systematic sub-samples of the full resolution data were computed using a resample 
function which attributes the lower resolution cell with the nearest neighbor elevation from the higher resolution 
source 1121 . Figure 3 shows statistics of the differences between ICESat GCP elevations from all laser 2 and 3 periods with 
respect to SRTM and theGMTED2010 Mean 15 arc-seconds and 30 arc-seconds DEMs for Australia. For comparisons 
between ICESat ground elevations (and similarly for centroid elevations for narrow waveforms), there is a systematic 
mean bias of about 2 m for SRTM with respect to ICESat elevation, with SRTM being higher. The negative bias is about 
3 m for the GMTED2010 datasets of which the mean and median 15 arc-second products are shown in Figure 3. The 30 
arc-second GMTED2010 topography is slightly higher in a mean sense than the 15 arc-second dataset by about 25 cm, at 
least at the location and time for the selected laser returns. These mean biases decrease slightly through time with 
decreasing laser energy, especially for Laser 2. If we do not take the two very low energy Laser 2 periods into account 
(2D and 2E), the variability of the differences between ICESat ground elevations and the 5 global DEMs does not vary 
by more than 0.5 meter across all laser periods. 

The other statistics shown here (standard deviations and RMSE) are stable through all laser periods, despite the 
disparities in the number of edited shots (about 100,000 for L2A, with large editing of saturated returns during this high 
energy period, to almost 500,000 for L2C and L3I), with L2E being an exception. Therefore, we speculate that ICESat 
inter-period biases are possibly correlated with decay in laser energy that led to lowering of the waveform processing 
thresholds. Also differential geographic sampling may have introduced between period-biases due to selective exclusion 
of returns from relatively brighter surfaces during the early periods with extensive waveform saturation. In contrast, 
during low energy periods areas with relatively dark surfaces yielding weak returns would be selectively excluded. 
Because SRTM, and therefore also GMTED2010, have spatially coherent, long-wavelength error undulations relative to 
our GCP control 161 differential geographic sampling could introduce the small between-period biases. Since SRTM is the 
primary source in GMTED2010 the difference in mean biases relative to the ICESat GCPs, with the GMTED2010 
products nearly one meter above SRTM, is unexpected. We infer that in the generalization process to lower resolution, in 
addition to an increase in the standard deviations of the elevation differences, the upward bias in GMTED2010 is 
introduced because all source SRTM cells are used including those displaced upward by vegetation cover 14, Our use of 
narrow width GCPs means that our assessment of the 90 m SRTM product is done only at footprint locations with 










minimal vegetation cover, whereas for GMTED210 vegetated areas become incorporated in the generalized cell 
elevations. Examination of elevation difference maps (e.g. Figure 2) show that the greatest upward bias in GMTED210 
occurs in coastal areas with forest cover, consistent with our inference. 

Table 2. Differences between ICESat and SRTM and GMTED products for Median and Mean at 15 arc-second resolution 
and Discrete Sample and Mean at 30 arc-second resolution for a representative Laser period (L3C) indicating the 
number of returns and the mean, standard deviation and RMSE of the differences with respect to ICESat ‘s centroid and 
ground (nearly the same for narrow returns) and the highest and lowest surfaces observed. 

















































































































Table 3. Differences between the ICESat GCP centroids and SRTM and GMTED products for Discrete Sample and Mean at 
30 arc-second (ds30 and mn30, respectively), and Median and Mean (mdl 5 and mnl5, respectively) at 15 arc-second 
resolution for all Laser 2 and 3 periods indicating the number of GCPs used (NP), and the means, standard deviations 
and RMSEs of the differences in meters. 


ICESat Period 





ICESat Period 





L2A31 2103 

NP 

wmsi 

STDV 

RMSE 

L3D 

NP 

MEAN 

STDV 

RMSE 

SRTM 

106868 

-1.86 

2.31 

2.96 

SRTM 

452400 

-2.07 

2.24 

3.05 

ds30 

106868 

-2.75 

3.24 

4.25 

ds30 

452400 

-2.97 

eksm 

4.70 

mn30 

106868 

-2.81 

2.71 

3.90 

mn30 


-3.03 

3.04 

4.29 

■BHEMSISil: 

106868 

-2.65 

2.09 

3.38 

mdl5 

452400 

-2.87 

2.23 

3.63 

mnl5 

106868 

-2.68 

2.11 

3.41 

mnl5 


-2.91 

2.26 

3.68 

L2B 

NP 

MEAN 

STDV 

RMSE 

L3E 

NP 

MEAN 

STDV 

RMSE 

SRTM 

274844 

-1.96 

2.24 

2.98 

SRTM 

380954 

-2.08 

2.24 

3.05 

ds30 

274844 

-2.85 

3.39 

4.42 

ds30 

380954 

-2.98 

3.69 

4.74 

mn30 

274844 

-2.90 

2.85 

4.07 

mn30 

380954 

-3.03 

3.08 

4.32 

mdl5 

274844 

-2.75 

2.09 

3.46 

mdl 5 

380954 

-2.88 

2.20 

3.62 

mnl5 

274844 

-2.78 

2.13 

3.51 

mnl5 

380954 

-2.92 

2.25 

3.69 

L2C 

NP 

MEAN 

STDV 

RMSE 

L3F 

NP 

MEAN 

STDV 

RMSE 

SRTM 

473896 

B91K 

2.36 

3.16 

SRTM 

438987 

-2.00 

2.25 

3.01 

ds30 

473896 

-2.97 

rim 

5.00 

ds30 

438987 

-2.90 

3.47 

4.52 

mn30 


-3.03 


4.59 


438987 

-2.94 

2,89 

4.12 

mdl5 

473896 


2.47 

3.79 

mdl5 

438987 

-2.80 

2.14 

3.52 

mnl5 


-2.92 

2.52 

3.85 

mnl5 

438987 

-2.84 

2.18 

3.58 

L2D 

NP 


STDV 

RMSE 

L3G 

NP 

MEAN 

STDV 

RMSE 

SRTM 

374051 

-2.34 

2.40 

3.36 

SRTM 

455341 

-2.06 

EMiH 

EK9M 

ds30 

374051 

-3.25 

4.93 

5.91 

ds30 

455341 

-2.93 

EMM 

ESZOT 

inn30 

374051 

-3.31 

4.27 

5.40 

mn30 

455341 

-2.98 

2.94 

4.19 

mdl5 

374051 

-3.12 

2.89 

4.25 

mdl5 

455341 

-2.85 

2.17 

3.58 

mn 15 

374051 

-3.18 

2.96 

4.35 

mnl5 

455341 


2.21 

3.63 

L2E 

NP 

MEAN 

STDV 

RMSE 

L3H 

NP 

MEAN 

STDV 

RMSE 

SRTM 

726595 

-2.41 

2.59 


SRTM 

422979 

-2.09 

2.26 

EEEMI 

ds30 

726595 

-3.34 

5.72 

6.62 

ds30 

422979 

-2.99 

3.67 

4.73 

mn30 

726595 

-3.42 

5.06 

6.11 

mn30 

422979 


EESM 


mdl5 

726595 


3.36 

nnm 

mdl5 

422979 

-2.89 


3.63 

mnl5 

726595 

wmm 

3.46 

4.76 

mnl5 

422979 

-2.93 

2.24 

3.69 

L3A 

NP 

AM!£I 

STDV 

RMSE 

L3I 

NP 

MEAN 

STDV 

RMSE 

SRTM 


-1.95 

2.22 

2.95 

SRTM 

488675 

-2.15 

2.27 

3.13 

ds30 

327543 

-2.83 

3.57 

4.55 

ds30 

488675 

-3.05 

3.53 

4.66 

mn30 

327543 

-2.87 

3.01 

4.16 

mn30 

488675 

-3.10 

2.95 

4.28 

mdl5 

327543 

-2.74 

2.15 

3.48 

mdl5 

488675 

-2.95 

2.19 

3.68 

■BHHBiSSgil 

327543 

-2.78 

2.20 

3.54 

mnl5 

488675 

-2.99 

2.23 

3.73. 

L3B 

NP 

MEAN 

STDV 

RMSE 

L3J 

NP 

MEAN 

STDV 

RMSE 

SRTM 

316537 

-2.01 

2.20 

Em 

SRTM 

447482 

-2.13 

2.25 

3.09 

ds30 

316537 

esih 

3.51 

4.54 

ds30 

447482 

-3.04 

3.47 

4.61 

mn30 

316537 

-2.93 

2.93 

4.14 

mn30 

447482 

-3.10 

2.89 

4.24 

mdl 5 

316537 

-2.80 

BEB 

3.53 

mdl5 

447482 

-2.93 

2.15 

3.63 

mnl5 

316537 

-2.84 

2.18 

3.58 

mnlS 

447482 

-2.97 

2.18 

3.69 

L3C 

NP 

mi 

STDV 

RMSE 

L3K 

NP 

MEAN 

STDV 

RMSE 

SRTM 

387123 

-1.97 

2.22 

2.96 

SRTM 

231122 

eh 

2.37 

3.23 

ds30 

387123 

-2.85 

3.58 

4.58 

ds30 

231122 

eEBE 

3.68 

4.80 

mn30 

387123 

-2.89 

2.95 

4.13 

mn30 

231122 

-3.12 

3.13 

4.42 

mdl5 

387123 

-2.76 

2.15 

EEOK 

mdlS 

231122 

-2.98 

2.34 

3.79 

mn!5 

387123 

-2.80 

2.18 

3.55 

mnl5 

231122 

-3.02 

2.37 

3.84 


3.2 Differences with respect to Land Cover 

We examined the elevation differences with respect to land cover using the classification provided by the regional 
Glocover data [lo l The GCP frequency as a function of class is shown in Figure 4 along with plots of the mean 
differences and standard deviations for each class for a representative ICESat period. Table 4 shows the statistics for the 
same period for the 15 arc-second products. 
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Fig. 4. Results for L2A GCP centroid elevation differences as a function of land cover class, with GCP frequencies per class 
(top left), a map of cover class at the GCP locations (top center) and plots of mean differences and standard deviations 
per class for the 15 arc-second Mean (mnl5) and Median (mdl5), and the 30 arc-second Mean (mn30) and Discrete 
Sample (ds30) GMTED2010 products and the SRTM 90 nt product.. The land cover classes are defined in Table 6. 


Table 4. Statistics number of points (NP) for differences between ICESat centroid elevations and GMTED2010 as a function 
of land cover at the GCP locations for laser period L2A, for two of the products evaluated: mn 1 5 ; Mean at 1 5” 
resolution (mn!5) and Median at 15” resolution (md!5). See Table 6 for Land Cover Classes [LC Class] definitions. 


1 ICESat L2A - GMTED20I0 Elevation Differences with Respect to Land Cover 

Product 

mnl5 

15” Mean 

mdl5 

15” Median 

LC Class 

Mean 

STDV 

RMSE 

NP 

Mean 

STDV 

RMSE 

NP 

14 

-1.92 

1.59 

2.96 

13922 

-1.87 

1.56 

2.89 

13922 

20 

-2.25 

1.39 

2.99 

4350 

-2.22 

1.41 

2.98 

4350 

30 

-2.86 

2.11 

4.13 

mm 

-2.71 

1.94 

| 

126 

40 

-5.69 

6.01 

10.23 

1096 

-5.50 

6.24 

10.40 

1096 

60 

-3.44 

2.51 

4.94 

3142 

-3.40 

2.52 

4.92 

3142 

110 

-2.35 

1.46 

3.13 

14846 

-2.33 

1.45 

3.11 

14846 

120 

-2.48 

1.67 

3.42 

13490 

-2.43 

1.65 

3.37 

13490 

130 

-2.56 

2.30 

4.14 

10836 

-2.53 

2.25 

4.07 

10836 

134 

-2.81 

1.83 

3.82 

6128 

-2.76 

1.76 

3.72 

6128 

140 

-3.16 

1.28 

3.64 

21590 

-3.14 

1.26 

3.61 

21590 

150 

-2.72 

1.20 

3.20 

113232 

-2.69 

1.19 

3.17 

113232 

170 

-1.48 

1.68 

2.80 

204 

-1.07 

1.87 

2.85 

204 

180 

-2.44 

0.99 

2.81 

18 

-2.21 

0.82 

2.50 

18 

190 

-2.34 

1.97 


508 

-2.24 

1.91 

3.51 

508 

200 

-2.72 

1.03 

3.08 

10246 

-2.69 

1.01 

3.04 

10246 






















































































































































Table 5. Same as Table 4, but for GMTED2010 Discrete Sample at 30” resolution (ds30) and Mean at 30” resolution (mn30) 
products. 



Product 

ds30 

30” Discrete Sample 

mn30 

30” Mean 


LC Class 

Mean 

STDV 

RMSE 

NP 

Mean 

STDV 

RMSE 

NP 

14 

-1.97 

2.35 

3.86 

13922 

-2.07 

1.86 

3.35 

13922 

20 

-2.36 

2.17 

3.87 

4350 

-2.42 

1.66 

3.37 

4350 

30 

-3.06 

2.42 

4.59 

126 

-4.60 

4.13 

7.44 

126 

40 

-5.70 

9.27 

14.30 

1096 

-6.43 

8.72 

13.91 

1096 

60 

-3.35 

3.66 

6.17 

3142 

-3.48 

3.27 

5.79 

3142 

110 

-2,44 

2.14 

3.89 

14846 

-2.49 

1.83 

3.59 

14846 

120 

-2.56 

2.44 

4.30 

13490 

-2.59 

2.12 

3.96 

13490 

130 

-2.57 

3.34 

5.38 

10836 

-2.65 

2.83 

4.80 

10836 

134 

-3.02 

2.91 

5.11 

6128 

-3.09 

2.43 

4.62 

6128 

140 

-3.24 

2.14 

4.44 

21590 

-3.30 

1.90 

4.26 

21590 

150 

-2.78 

1.91 

3.87 

113232 

-2.82 

1.50 

3.53 

113232 

170 

-1.35 

2.27 

3.48 

204 

-1.62 

1.72 

2.92 

204 

180 

0.68 

3.25 

4.65 

18 

-1.44 

3.03 

4.52 

18 

190 

-2.04 

2.59 

4.20 

508 

-2.45 

2.48 

4.28 

508 

200 

-2.88 

1.82 

3.87 

10246 

-2.91 

1.30 

3.45 

10246 


Table 6. Definition of the 22 Level 1 Globcover classes used in this analysis. 


LC Value Label 

1 1 Post-flooding or irrigated croplands (or aquatic) 

14 Rainfed croplands 

20 Mosaic cropland (50-70%) / vegetation (grassland/shrubland/forest) (20-50%) 

30 Mosaic vegetation (grassland/shrubland/forest) (50-70%) / cropland (20-50%) 

40 Closed to open (>15%) broadleaved evergreen or semi-deciduous forest (>5m) 

60 Open (15-40%) broadleaved deciduous forest/woodland (>5m) 

70 Closed (>40%) needleleaved evergreen forest (>5m) 

100 Closed to open (>15%) mixed broadleaved and needleleaved forest (>5m) 

1 10 Mosaic forest or shrubland (50-70%) / grassland (20-50%) 

120 Mosaic grassland (50-70%) / forest or shrubland (20-50%) 

130 Closed to open (>15%) (broadleaved or needleleaved, evergreen or deciduous) shrubland (<5m) 

140 Closed to open (>15%) herbaceous vegetation (grassland, savannas or lichens/mosses) 

150 Sparse (<15%) vegetation 

Closed to open (>15%) broadleaved forest regularly flooded (semi-permanently or temporarily) - Fresh or 
160 brackish water 

170 Closed (>40%) broadleaved forest or shrubland permanently flooded - Saline or brackish water 

Closed to open (>15%) grassland or woody vegetation on regularly flooded or waterlogged soil - Fresh, brackish 
1 80 or saline water 

1 90 Artificial surfaces and associated areas (Urban areas > 50%) 

200 Bare areas 

210 Waterbodies 

220 Permanent snow and ice 




The lowest standard deviations occur for bare areas, with mean differences of -2.88 m ± 1.82 m and 3.87 m RMS for the 
Mean 15 arc-second products, and -2.91 ± 1.30 nr and RMSE of 3.45 m for the Median 15 arc-second product (Table 4). 
Larger negative mean differences (GMTED higher) are observed for vegetated classes. The mean differences and 
standard deviations are consistent with the vegetation height and density of the classes. For the Mean and Median 15 
arc-second products, the largest mean differences (-5.69 m ±6.01 m and -5.50 ± 6.24 m) are observed for closed to open 
(>15%) broadleaved evergreen or semi-deciduous forest (>5m) (Table 4). Similar statistics are shown for the Discrete 
Sample and Mean products at 30 arc-second resolution, with means of -5.70 m ± 9.27 m and an RMSE of 14.30 m and 
means of -6.43 ± 8.72 m, and an RMSE of 13.91 m, respectively (Table 5). The largest represented class (113,232 
GCPs), corresponding to sparse (<15%) vegetation, has smaller elevation differences and standard deviations than the 
forest class, with mean differences of -2.72 m ± 1.20 m and a 3.20 m RMSE, and -2.69 ± 1.19 m with a 3.17 m RMSE 
for Mean and Median products, respectively The lower resolution products show -2.78 ± 1 .91 with a RMSE of 3.87 m 
and -2.82 ± 1.50 nr with RMSE of 3.53 nr (Table 5). These differences as a function of class vegetation height and 
density are consistent with our inference that the upward bias of SRTM caused by vegetation is being introduced by 
generalization into the GMTED products. 


3.3 Differences with Respect to Relief 

Relief at the location of the ICESat GCPs was computed using the standard deviation of the SRTM (V2.0) elevations for 
the 3 x 3 array of cells (at 90 m resolution) that include and surround the footprint geolocation. For the selected GCPs, 
most of the relief is less than 5 m. Frequency distributions of relief binned at 0.5 m for all the periods analyzed show 
that most of the GCPs occur into the 3.5 to 4.5 m relief categories. Statistics for the various relief categories are shown 
in Table 7 for the SRTM, and GMTED2010 Mean and Median products at 15 arc-second resolution using the Laser 3C 
period GCPs. Table 8 shows those statistics for the Mean and Discrete Sample GMTED2010 products at 30 arc-second 
resolution, while Figure 5 shows (top right) the relief category frequencies of occurrence. The distributions for ICESat 
minus SRTM are also shown for comparison. For all cases, means and standard deviations are consistent, with SRTM 
mean differences showing smaller means by approximately 1 m with respect to the GMTED2010 products, all of them 
higher with respect to ICESat centroid elevations. The largest negative means are observed for the relief category 
between 2 and 2.5 m, which also shows the largest standard deviations on the order of 2 m with RMSEs of 
approximately 4 m. However, there is no trend as a function of relief and the differences in the mean biases for the relief 
categories is very small, less than about 1 m. 


Table 7. Statistics for the differences by relief category between ICESat centroid elevations and SRTM and GMTED2010 
Mean and Median 15 arc-second products (MN15 and MD15, respectively) for the L3C period. 













Relief 

(m) 

Mean 

(m) 

(m) 

RMSE^ 

(m) 

Mean 

(m) 

(m) 

RMSt 

(m) 

Mean 

(m) 

STDEV 

(m) 

RMSE 

On) 

NP 

>=0.5 to 1 .0 

-2.54 

1.51 

3.31 

-3.67 

1.66 

4.36 

-3.63 

1.75 

4.39 

98 

>=1.0 to 1.5 

-2.77 

1.48 

3.47 

-3.61 

1.46 

4.16 

-3.50 

1.47 

4.07 

352 

>=1.5 to 2.0 

-2.83 

2.05 

4.05 

-3.63 

2.73 

5.30 

-3.57 

2.77 

5.30 

1518 

>=2.0 to 2.5 

-2.93 

1.76 

3.85 

-3.97 

2.46 

5.28 

-3.92 

2.30 

5.10 

5406 

>=2.5 to 3.0 

-2.72 

1.76 

3.69 

-3.60 

1.86 

4.46 

-3.55 

1.84 

4.41 

13050 

>3.0 to 3.5 

-2.45 

1.75 

3.48 

-3.28 

1.76 

4.12 

-3.23 

1.74 

4.05 

29030 

>=3.5 to 4.0 

-1.74 

1.55 

2.80 

-2.54 

1.34 

3.16 

-2.51 

1.32 

3.13 

324742 

>=4.0 to 4.5 

-2.02 

1.53 

2.96 

-2.89 

1.51 

3.59 

-2.84 

1.48 

3.53 

274210 

>=4.5 to 5.0 

-2.20 

1.56 

3.11 

-3.05 

1.86 

4.03 

-2.98 

1.83 

3.95 

125738 

>5.0 

-2.30 

1.57 

3.19 

-3.18 

1.95 

4.21 

-3.00 

1.89 

4.02 

102 




Table 8. Statistics for the differences by relief between ICESat centroid elevations and GMTED2010 Mean and Discreet 
Sample 30 arc-second products (MN30 and DS30, respectively) for the L3C period. 


L3C 

MN30 



DS30 





warn 

ISM- 

KSMl 

ISKm 

ISBKs 

■ tMMM 

ISk, 

NP 

>=0.5 to 1.0 

-3.67 

2.12 

4.74 

-3.18 

2.50 

4.75 

98 

>=1.0 to 1.5 

-4.00 

2.32 

5.17 

-3.59 

2.77 

5.31 

352 

>=1.5 to 2.0 

-3.77 

3.65 

6.39 

-3.77 

3.89 

6.67 

1518 

>=2.0 to 2.5 

-4.05 

3.35 

6.23 

-4.07 

4.47 

7.52 

5406 

>=2.5 to 3.0 

-3.72 

2.61 

5.24 

-3.63 

2.96 

5.54 

13050 

>3.0 to 3.5 

-3.41 

2.46 

4.87 

-3.36 

2.89 

5.29 

29030 

>=3.5 to 4.0 

-2.61 

1.67 

3.52 

-2.58 

2.10 

3.93 

324742 

>=4.0 to 4.5 

-2.99 

2.07 

4.19 


2.51 

4.62 

274210 

>=4.5 to 5.0 

-3.12 

2.68 

4.91 

-3.08 

3.19 

5.47 

125738 

>5.0 

-3.20 

2.74 

5.02 

-3.14 

2.87 

5.13 

102 
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Fig. 5. Elevation difference means and standard deviations as a function of relief category between the ICESat L3C GCP 
centroids and the SRTM 90 m, and GMTED 2010 products for the mean and median at 15 arc-seconds (mnl5 and 
mdl5, respectively), and mean and discreet sample at 30 arc-seconds (mn30 and ds30, respectively) The histogram 
shows the relief category frequencies of occurrence at 0.5 m binning. 


Means, standard deviations and RMSEs are larger for the 15 arc-second products, with RMSEs not exceeding 5.3 m and 
as low as 3.13 m. The largest represented category is relief between 3.5 m and 4 m, with 324742 returns, where mean 
differences are the lowest for both 15 arc-second products, with a mean of -2.54 m, a standard deviation of 1.34 m and an 
RMSE of 3.16 m for the mean product, and a mean of -2.51 m, a standard deviation of 1.32 m, and an RMSE of 3.13 m. 
For the GMTED2010 30 arc-second resolution mean products, the most negative means are shown also for 2.0 to 2.5 m 




















































































relief, with a standard deviation of 3.35 m and an RMSE of 6.23 m. The largest mean and standard deviation for the 
Discrete Sample at 30 arc-second resolution are -4.07 m and 4.47 m, with a 7.52 m RMSE. The largest represented 
category with relief between 3.5 m and 4 in shows a mean of -2.61 m, a standard deviation of 1.67 m and RMSE of 3.52 
m for the Mean product, and -2.58 m, 2.1 m and 3.93 m for the Discrete Sample product. 


4. DISCUSSION AND CONCLUSIONS 

The ICESat laser altimetry data is an important contributor for global geodetic control of elevation data. It provides 
accurate and consistently reference geodetic quality data that can be used to assess the accuracy of DEMs, providing 
necessary information for studies where well understood error characteristics of terrain elevation data is required. 
Expanding on our prior work assessing the SRTM and GDEM data sets, we have quantified the error characteristics of 
the GMTED2010 elevation products for the Australian continent. Our analysis documents that the GMTED2010 
products are a significant improvement over their predecessor GTOPO30 DEM, and provide new, systematically-derived 
global topographic data at resolutions appropriate for regional to continental applications where the higher resolution 
data sources are not necessary. 

Prior to our work using ICESat, the GMTED2010 project evaluated the accuracy of the data set using a variety of 
reference data, including other raster DEMs and NGA control point datasets that are derived from photogrammetric 
sources. A complete data quality assessment for these products that includes a discrimination of biases by source data is 
presented in the documentation accompanying the dataset. As expected, the largest RMSEs are seen for those cells that 
were filled with GTOPO30 as the input source. Relevant to our analysis, since 90 m SRTM is the main source in 
Australia, is the absolute accuracy assessment performed for the 90 m SRTM source data compared with the NGA 
control. This shows a 2.37 m bias ± 15.91 m for the 15 arc-second mean product, and a 1.9 m bias ± 15.25 m for the 
Median product. The 30 arc-second Mean product showed a 4.0 m bias ± 26.12 m, and a 3.51 m bias ± 25.06 m for the 
Systematic Discrete Subsample product. Our results yield mean biases of comparable magnitude, of a few meters, but 
dramatically smaller standard deviations that we attribute to the significantly higher accuracy ICESat GCPs, produced in 
a consistent, global reference frame. Use of the less accurate NGA control points leads to an erroneously high 
assessment of GMTED2010 error. It is only with control having accuracies substantially better than the data set to be 
evaluated that meaningful error assessments can be performed. Using the ICESat GCPs we have provided that 
assessment for the GMTED2010 Australian products, documenting that their errors are well within the requirements for 
the products, which were required to exceed the accuracy of GTOPO30. 

In future work ICESat GCP data will be used to evaluate these products globally, providing assessments where other 
data for control purposes is scarce or of poor quality, in particular in northern and southern latitudes above and below 
±60°. This work developing the ICESat GCP dataset is contributing to a CEOS-sponsored project coordinating the 
development of a global, integrated elevation database produced from different sources, embedded into a consistent, high 
accuracy, and long-term stable geodetic reference frame. Our GCP database will be a key means to establish a much- 
needed global topography reference frame to facilitate consistency and interoperability among DEM datasets. Our 
methodologies developed to use ICESat data for global geodetic control are a pathfinder for similar use of data to be 
produced by the follow-on ICESat-2 mission scheduled for launch in 201 6 [1 . ICESat-2 will provide substantially 
improved sampling as compared to ICESat, acquired using multi-beam, higher-resolution elevation data derived using an 
advanced micropulse, photon counting measurement approach. We are adapting our approach and developing new 
algorithms using simulated ICESat-2 datasets in order to take full advantage when this new global geodetic control data 
set becomes available. 
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